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University,  of  Massachusetts 

The  Supervisory  Committee  submits  this  report  to  the 
Justices  in  accordance  with  its  mandate,  which  was  set  forth  in 
the  report  of  the  Advisory  Committee  on  Judicial  Performance 
Evaluation: 


u[T]he  supervisory  committee  should  report  to  the  Supreme 
Judicial  Court  appraising  the  various  alternative  programs 
and  setting  forth  recommendations  for  the  future  operation 
of  a  judicial  performance  enhancement  program  in 
Massachusetts . " 

A  description  of  the  work  of  the  Supervisory  Committee  through 
November  1991  is  contained  in  the  Committee's  Interim  Report  to 
the  Court. 


Since 'the  submission  of  the  Interim  Report,  the  Supervisory 
Committee  has  been  meeting  to  review  and  discuss  efforts  to 
implement  enhancement  programs  in  the  various  departments.  In 
some  departments,  the  nature  of  the  program  has  changed 
significantly  since  the  submission  of  this  Committee's  Interim 
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Report.     A  copy  of  the  program  currently  in  place  in  each 
department  is  enclosed  as  an  attachment  to  this  report.  Also 
enclosed  is  a  report  from  each  of  the  Chief  Justices  which 
describes  the  department's  program  and  the  experience  to  date 
with  implementation.     As  was  the  case  when  this  Committee 
submitted  its  Interim  Report,   efforts  at  implementation  of  the 
programs  have  not  been  consistent  among  the  departments. 
Therefore,   in  some  cases,  the  Committee  has  been  unable  to  fully 
consider  the  merits  and  disadvantages  of  all  aspects  of  every 
department's  program. 

2 .     Discussion  of  Programs 

As  you  will  note  after  reviewing  the  programs,  there  are 
similarities  in  the  approaches  undertaken  by  many  of  the 
departments.     The  Juvenile  Court  Department  was  the  first  to 
begin  implementation  of  an  enhancement  program.     In  that 
department,   experienced  justices  are  appointed  by  the  Chief 
Justice  to  serve  as  evaluators.     Only  justices  with  at  least  two 
years  experience  are  asked  to  participate  in  the  program  as 
evaluees.     The  evaluators  conduct  a  series  of  personal  interviews 
with  attorneys,  court  staff  and  personnel  from  agencies  regularly 
appearing  in  the  Juvenile  Courts.     To  preserve  confidentiality, 
the  interviews  are  conducted  away  from  the  Juvenile  Court  section 
of  the  courthouse.     In  some  locations,  they  are  held  outside  the 
courthouse.     The  evaluator  uses  a  standard  set  of  questions  to 
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elicit  information  during  the  interview  but  no  forms  are 
completed  by  the  interviewees.     After  the  interviews  have  been 
completed,  the  evaluator  prepares  a  summary  of  the  information 
received  during  the  interviews  for  the  Chief  Justice  of  the 
Juvenile  Court  Department.     The  evaluator,  Chief  Justice  and  the 
justice  being  evaluated  then  meet  to  discuss  the  process.  After 
this  meeting,   all  notes  and  other  records  relating  to  the 
evaluation  are  destroyed. 

Because  of  the  generally  positive  reactions  in  the  Juvenile 
Court  Department  from  both  justices  performing  evaluations  and 
those  being  evaluated,   other  departments  adopted  either  the 
substance  of,  or  certain  features  from,  the  Juvenile  Court 
Department's  program.     The  program  in  the  Probate  and  Family 
Court  Department  also  relies  heavily  on  personal  interviews  as  a 
source  of  data  on  the  judge  being  evaluated.     As  in  the  Juvenile 
Court,   interviews  are  held  with  attorneys  and  court  staff. 
Retired  justices  from  the  Probate  Court  serve  as  evaluators. 
Unlike  the  procedure  in  the  Juvenile  Courts,  upon  the  completion 
of  the  interviews,  the  Chief  Justice  of  the  Probate  Court  does 
not  participate  in  the  meeting  between  the  evaluator  and  justice 
being  evaluated.     The  Probate  Court's  program  allows  the 
evaluator  to  gather  information  from  the  following  additional 
sources:     courtroom  observations,  tape  review,  self-evaluations, 
review  of  opinions  and  examination  of  management  statistics. 
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The  Land  Court  Department  also  uses  personal  interviews  to 
gather  information  on  the  justice  being  evaluated.     As  in  the 
Probate  Court,   a  retired  justice  serves  as  evaluator  and  meets 
with  attorneys  and  court  staff.     Following  the  interviews,  the 
evaluator  meets  with  the  justice  being  evaluated  to  discuss  the 
interviews.     The  Chief  Justice  does  not  participate  in  this 
meeting. 

The  program  in  the  Boston  Municipal  Court  Department  is 
similar.     It  will  gather  data  from  personal  interviews  conducted 
by  a  retired  Chief  Justice.     Those  interviewed  will  include 
attorneys,   court  employees  and  providers  of  services  to 
defendants.     Interviews  will  be  conducted  off  site.  After 
interviews  are  completed,   the  evaluator  and  the  Chief  Justice 
will  meet  with  the  justice  being  evaluated  to  discuss  findings. 
Any  written  materials  developed  during  the  process  will  be 
destroyed  following  the  interview.     Implementation  of  the  BMC's 
program  will  commence  in  July  1992. 

The  program  in  the  District  Court  Department  has  been 
modified  in  a  number  of  respects  during  the  past  two  years.  The 
final  program  is  still  evolving.     Initially,  the  plan  focused  on 
a  review  of  videotapes  of  court  sessions.     Because  of  fiscal 
considerations,  the  alternative  of  reviewing  audiotapes  was 
selected.     A  reviewing  team  composed  of  two  District  Court 
justices  listens  to  randomly  selected  tapes  of  certain 
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proceedings.     A  written  checklist  is  used  as  a  tool  for  the 
reviewing  justices.     The  program  is  aimed  at  newly  appointed 
justices.     After  reviewing  typically  6-8  hours  of  audiotape,  the 
reviewing  judge  meets  with  the  reviewed  judge  to  discuss  the 
results.     The  Chief  Justice  of  the  District  Court  does  not 
participate  in  this  meeting.     The  reviewing  judges  periodically 
meet  with  the  Chief  Justice  to  discuss  the  general  operation  of 
the  program.     At  the  direction  of  the  Supervisory  Committee,  the 
District  Court  expanded  its  program  to  include  solicitation  of 
input  from  additional  sources.     Initial  attempts  at  attorney 
input  consisted  of  requesting  information  from  two  or  more 
attorneys.     The  Supervisory  Committee  suggested  that  greater 
attorney  participation  is  needed  and  the  District  Court  plans  to 
expand  this  component  of  its  program.     Solicitation  of  input  from 
court  personnel  is  also  planned  for  future  reviews. 

The  program  in  the  Superior  Court  Department  differs 
significantly  from  those  in  the  other  departments  in  that  it 
includes  a  written  attorney  questionnaire  as  a  method  of  data 
gathering.     The  attorney  questionnaire  is  intended  to  be  used  in 
conjunction  with  a  self  evaluation  questionnaire  completed  by 
participating  justices.     The  Superior  Court  is  currently  in  the 
process  of  establishing  procedures  for  conducting  the  attorney 
survey.     No  questionnaires  have  yet  been  mailed  to  attorneys. 
The  department  plans  to  enter  the  data  received  from  the 
questionnaires  into  its  computer.     At  an  interview  with  the  Chief 
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Justice  of  the  Superior  Court   (or  his  designee) ,   the  justice 
being  evaluated  will  have  an  opportunity  to  compare  his  or  her 
self-evaluation  with  the  statistical  profiles  of  colleagues.  The 
Superior  Court  Chief  Justice  expects  that  the  first  round  of 
evaluations,   involving  14  justices,  will  be  completed  before  the 
end  of  September. 

The  program  in  the  Housing  Court  Department  also  differs 
from  the  model  used  in  the  Juvenile  Court  Department.     The  data 
gathering  in  the  Housing  Court  Department  consists  of  self- 
evaluation  and  review  of  audio  tapes.     The  Chief  Justice  of  the 
Housing  Court  plans  to  meet  individually  with  the  judges  to 
discuss  the  self-evaluation  and  tape  review. 

3 .  Recommendations 

A.     Experience  with  implementation  has  been  substantial  in  a 
number  of  the  departments.     In  the  Juvenile  Court,  more  than  50% 
of  the  judges  have  participated.     Eleven  of  the  40  Probate  Court 
judges  have  been  reviewed.     In  the  District  Court,   28  judges  have 
participated  and  an  additional  round  of  reviews  is  ongoing. 
Reactions  from  virtually  all  of  the  judges  participating  as 
evaluees  and  evaluators  have  been  positive.      (A  sample  of 
reactions  to  implementation  of  the  program  can  been  seen  in  the 
attached  memo  dated  4/18/92  regarding  the  Probate  Court  program.) 
As  time  passes,   enthusiasm  for  the  programs  has  grown.  Judges 
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were  frequently  considerably  more  skeptical  at  the  outset  than 
they  were  once  programs  became  operational.     In  some  departments, 
requests  to  take  part  in  the  program  have  exceeded  the  number  of 
justices  the  program  can  accommodate.     Those  justices  undergoing 
evaluation  have  found  it  a  positive,  useful  and  educational 
experience.     An  unexpected  benefit  from  the  program  in  many 
departments  has  been  the  value  of  the  exercise  to  those  justices 
who  have  served  as  evaluators.     Service  as  an  evaluator  has 
provided  an  additional  opportunity  for  justices  to  reflect  on 
their  own  actions  and  experiences. 

Because  operation  of  the  program  has  been  viewed  as  a 
benefit  to  those  justices  who  have  participated,  the  Supervisory 
Committee  recommends  that  a  judicial  performance  enhancement 
program  should  continue  to  operate  throughout  the  trial  court. 
The  program  should  be  shaped  and  run  by  the  courts.     The  sole 
objective  of  the  program  should  be  to  assist  judges  in  improving 
their  performance.     The  program  should  be  easy  to  administer  and 
should  contain  no  undue  imposition  on  the  justices. 

B.     The  performance  enhancement  program,  within  the 
limitations  set  forth  in  this  section  B,   should  allow  for  the 
continued  experimentation  with  different  approaches  among  the 
trial  court  departments.     At  this  point  in  the  history  of  the 
departments'  efforts,  the  Supervisory  Committee  is  unable  to 
categorically  state  that  a  standard  enhancement  program  is 
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preferable  or  to  define  its  components.     Differences  in  the 
departments  do  appear  to  justify  different  programs.     Also,  as 
noted  above,  certain  features  of  some  departments'  programs 
remain  to  be  implemented.     Most  notably,  the  Superior  Court  is 
just  beginning  its  efforts  to  use  questionnaires  mailed  to 
attorneys  to  gather  data  under  its  program.     The  Supervisory 
Committee  recommends  that  this  approach  be  continued  so  that  th 
use  of  written  attorney  questionnaires  can  be  later  evaluated  i 
light  of  actual  experience  with  this  method  of  data  gathering. 

Although  the  Supervisory  Committee  recommends  that  each 
department  should  be  allowed  to  structure  its  own  program,  the 
Committee  also  recommends  that  the  program  in  each  department 
include  the  following  mandatory  components: 

i.   attorney  input  -  In  the  opinion  of  the  Committee,  no 
evaluation  program  can  be  complete  without  input  from  attorneys 
Because  of  their  unique  involvement  with  and  knowledge  of  the 
court  and  its  operations,   attorneys  should  be  an  integral  part 
the  data  gathering  element  in  each  department's  program. 

ii.   employee  input  -  Similar  to  attorneys,   court  staff  are 
frequently  able  to  provide  a  unique  perspective  and 
constructive  information  about  judicial  performance. 
Depending  on  the  department,   the  Supervisory  Committee 
recommends  that  employee  input  include  solicitation  of 
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comments  from  a  representative  sample  of  clerks  and  their 
assistants,  clerical  personnel,  probation  officers  and  court 
officers . 

iii.   self-evaluation  -  In  the  Committee's  view,   self -evaluation 
provides  a  useful  opportunity  for  each  judge  to  reflect  on 
his  or  her  judicial  skills  and  behaviors.     The  exercise  of 
examining  one's  own  behavior  can  make  more  thoughtful  and 
meaningful  later  discussions  concerning  the  observations 
made  by  others. 

iv.   involvement  of  Chief  Justices  -  To  best  attain  the 

objective  of  assisting  judges  improve  their  performance,  the 
Supervisory  Committee  recommends  that  the  departmental  Chief 
Justice  play  a  leading  role  in  the  enhancement  program.  It 
is  essential  that  the  Chief  Justice  be  committed  to  the 
program  and  demonstrate  this  commitment  by  taking  an  active 
part  in  responding  to  issues  and  concerns  brought  to  light 
by  the  program.     The  Committee  recommends  that  the  Chief 
Justices  participate  in  the  meeting  between  the  evaluator 
and  the  justice  being  evaluated.     If  participation  by  the 
Chief  Justice  in  this  meeting  is  not  feasible,   a  report 
summarizing  the  discussion  at  the  meeting  should  be  given  to 
the  Chief  Justice. 
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C.  The  Supervisory  Committee  reiterates  the  conclusion  of 
the  Advisory  Committee  on  Judicial  Performance  Evaluation  that 
confidentiality  under  performance  evaluation  programs  must  be 
absolute.     If  confidentiality  cannot  be  assured,  a  program  of 
enhancement  should  not  be  implemented. 

To  insure  that  absolute  confidentiality  is  maintained,  the 
Supervisory  Committee  recommends  that  all  data  developed  as  part 
of  an  enhancement  program  be  destroyed  at  the  conclusion  of  the 
review  of  each  justice.     The  Committee  recommends  adoption  of  the 
approach  followed  by  many  departments  whereby  at  the  conclusion 
of  the  meeting  with  the  evaluator,   Chief  Justice  and  justice 
being  evaluated,   all  notes,   forms  and  any  other  material 
generated  during  the  process  are  destroyed.     The  Supervisory 
Committee  recommends  that  no  data  concerning  the  review  of  a 
justice  be  entered  into  a  computer  data  base. 

D.  As  stated  above  in  paragraph  A,   assistance  to  the  judges 
must  be  the  goal  of  a  performance  enhancement  program.  The 
program  should  be  educational  for  judges,   focusing  on  their 
professional  growth  through  constructive  feedback  and 
collaborative  solutions.     For  the  program  to  be  meaningful, 
methods  of  responding  to  the  problems  and  concerns  of 
participating  justices  must  be  developed.     Although  differences 
in  departments  may  justify  differences  in  programs,  many  issues 
and  concerns  flowing  from  the  pressures  of  the  judicial  process 
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are  common  to  all  judges,  and  the  Supervisory  Committee  suggests 
that  an  interdepartmental  group  be  developed  to  serve  as  a 
resource  to  address  problems  and  concerns  that  arise  repeatedly 
in  the  various  departments'  programs.     Suggestions  for 
educational  initiatives  could  be  made  by  this  group,  as  well  as 
by  the  Chief  Justices.     An  appropriate  support  structure  to 
respond  to  problems  and  discuss  and  initiate  improvements  will  be 
key  to  the  successful  operation  of  an  enhancement  program. 

Conclusion 

The  members  of  the  Supervisory  Committee  would  be  happy  to 
discuss  with  the  Justices  the  foregoing  comments  and 
recommendations  and  to  provide  further  detail  on  the  operation  of 
the  various  programs.     As  more  experience  is  gained  under  the 
program,   the  Committee  expects  that  the  value  of  the  enhancement 
process  to  the  individual  judges  and  the  judicial  system  as  a 
whole  will  be  confirmed. 
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